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The study Was designed to determine whether cloze 
procedure could be used in adult literacy programs for students 
reading at or above the fourth grade level by investigating the 
procedure's: acceptability for the students^ utility in matching 
students to^rfeading material^ and substitutability for standardized / 
tests. Eighty- five Rhode Island students, 35 in advanced Adult Basic' 
Education (ABE) classes and 50 in high school equivalency classes, / 
completed cloze passages taken from three sources. Deletions were At 
the 1:5 ratio. Data analysis was done on exact replacements. Cloz^ 
procedure was found acceptable as fewer than 25% of the students/ 
rated it uninteresting and only 7% of the 122 items were not / 
attempted by at least 75% of the students. It appears to be us.eful in 
.matching students to instructional materials sis more advanced groups ' 
of students show higher mean scores than less advanced groups; and 
means scored on passages of similar difficulty levels were 
significantly correlated. The data proved insufficient to answer the 
question on substitutability for standardized tests. The paper 
develops some suggestions for practical applications of cloze 
procedure ±n adult literacy programs. A 1 2-item bibliography is 
included. (Author/MS) 
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THE USE OP CLOZE f^ROCEDURE IN ADULT LITERACY PROGRAMS 

CsLtherine Rosenkranz, Ph.D.. 

Elimination of illiteracy has high priority in adult 
education programs although recent data seems to indicate 
that- little, if any, .progress is occuring in the U.S. 
Both the University of Texas Adult Performance JLevel Study (pL) 
and the National Assessment ^of Educational Progress (2) 
clearly indicate thia't,cin spite of increasing percentages 
of peoDle completing eight and twelve years of foi?mal 
schooling, a significant number of adults are unable to 
complete test items designed to measure their literacy in 
terms t)f functional skills, such as • reading classified ads. 

/ ■ • ■ 

^Instruments /designed for both of these studies are 
criterion -referenced, showing a trend away from defining 
literacy either /by years of schooling completed or ability 
to score at a predetermined criterion level on a norm- 
referenced test/. However, years of schooling continues to/ 
be the current /basis for assessing need for adult funda- / 
mental educatijbn. Using this criterion, an appallingly / . 
small percentafge of adults eligible for free classes are / 
actually part/lcipating. ^A 197k report from Rhode Island (3) 
estimated thf(t only two, to tliree percent of. tnose eligible 
enrolled. This report con^^luded that enrollment would not 
Increase until potential students perceive the program as 
teaching immediately relevant skills through materials/ 
which meet both their interest* and egp needs. 

STATEMENT OP THE PROBLEM ' 




Many ABE teachers have attempted to meet the need for' 
student relevance by use of class or program designed mat.^- 
erials or by bringing current periodicals and 'hewspap^ers'" 
into the classroom. A number of publishers and special 
demonstration projects have also developed adult -oriented 
materials. This practice has presented new problems in 
matching students to reading material of ■ anpropri.ate re^d^'na: 
difficulty level. ' ^ : ^ 

Si.- 
o 

Cloze procedure has been suggested as an ai^propriate 
testing technique for ABE because ic assesses b^bth the. 



readability of material and rsadini> ability of /students. 
Cloze creates a teat passage through systematic mutliation . 
of narrative Passages by deletion of words according to a 
pre-established schedule. The reader responds by replacincr ' 
the deleted words. Particular strengths of cloze are par-'^ 
simony of resources needed to design test passa^^es and 
sensitivity to individual differences in reading ability and 
backsiround information* 
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The nroblems to be researched were: 

1. Is cloze procedure acceptable for this group? 
2\ Can cloze' procedure be used to match students to 

instructional materials? 
3* Can it be substituted for standardized te^sts? 

METHOD 

Review of the extensive research on use of cloze 
with children led to .selection of Bormuth's paradigm of 
a 1:5 deletion ratio and exact renlacement scoring with 
criterion levels of 50^ or higher indicating independent 
reading level, 35 - 1+9^ indicating instructional reading " 
level and less than 35% completion indicating lack of infor- 
mation/gain. . ' . 

Classes in which testing was to take place were 
selected sa-.that the. resulting data v/culd represent what 
Kerlinger {Ip terms a "purposeful" samDle. Classes 
represenl"ed two levels, of students: Advanced ABE (i|th 
through 8th grade) with a total of 35 respondents, and 
high school equivalency review (HSE )* with- a total of 50 
resr^ondents . Classes met downtown,, inner city residential, and 
suburban areas; 'daytime and • nighttime ; and in a penetentiary . 
All students attending- on the day the' teacher administered 
the test were included in the study. 

o 

Passages were selected from three sources: some were 
replications of passages used in a study done by the Madison, 
Wisconsin, Dublic* schools. Some were constructed from 
randomly selected passages in commercial publications for 
advanced ABE or HSE classes. Each- test booklet consisted 
of passages at the appropriate difficulty level, studgnt 
instructions, a sample passage, and a questionnai At 
all- except one site which reouested taped instructions, the 
teachers re^d the instructions.. The easiest passage was 
always placed first; other passages were mixed in placement 
to minimize copying and avoid unintended bias- que to 
plac ement . - . 

Data was coded by a graduate student and analyzed by 
comruter. *Two variables -^were created f or canalysis : 
readin^^ ability for each student which v^as analogous to 
a weis;hted mean score and a J2;roup mean on each passae:e. 

Acceptability of cloze was judoied from two sources of 
data: how . the stufient said he felt about the procedure on 
the questionnaire and his "' actual performance in attempting 
to complete deletions. 

Utility of cloze as a testing instrument: was evaluated 
b:/- examining its ability to discriminate between levels of 
student abilities. Correlation coefficients of passa^.e 
means were computed as were contingency coeff icients , comparing. 



the distribution of respondents over the three criterion 
levels between pairs of passages. 

Substitutabllitj for standardized tests could, be 
demonstrated by comparing T)assage means obtained by school 
children of a known grade ' equivalent level with adult, scores 

RESULTS . . 

Acceptability of cloze procedure was shown by the 
students* persistence in respondir./^ to cloze items acid 
their Dositive response to the questionnaire. Percentage 
o.f deletions attempte^d always exceeded 50^ on even the 
most difficult passages. Only nine out of 122 items--C7^J_ 
were' a:ttempted less than 7S% of the time. This response 
rate met the criterion level established by the researcher 
for acceptability. It was considered especially positive 
since more than 15^ of the sample were incarcerated males 
who were known to be markedly uncooperative in test situ- 
ations • u • 

Resperlses to the question on test interest reached 
the criterion level of fewer than 255^ unfavorable responses* 

Rating Chosen 
I Very boring ^ 

Uninteresting 
I So-so 

Interesting 
Very interesting 
No response 

Total (N=85) 



% of Responders 
22?^ 

100^ 



; Also, more than half of the students found the test 
satisfactory in length and less than haif rated it as of 
greater than average difficulty level. 

Utility in matching students to reading material was 
examined first by ascertaining whether scores bn three 
over-laruing passages resulted in mean scores for HSE stu- 
dents which were significantly hisher ttian mean scores- 
attained by ABE students. Table 1 shows that the means are 
significantly different at the .05 level. 
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TABLE 1 

COMPARISON OP MEANS BY LEVELS 
ON THREE PASSAGES 







Level- 2 




Level 1 






Passae;e 








Mean S.D. 


n" 


.05- 


Weight 


(1) . 


.75 .15 


50 


.67 .22 


35 


sig. 


Spending 


(2) 


.kS .19 


ill 


.38 .21 


35 


sig. ^ 


Stoves 


(6) 


.51 .19 


11 


.35 ■ -2k. 


35 


sig. 



Two-tailed test 



In addition, where passages were designed to be of simi- 
lai! difficulty by the t)ublisher, mean scores for the passages 
were found to have a significant, positive correlat ion. . This 
tends to su-orort the hypothesis that cloze procedure can be 
used to match students to instructional materials. 

Further data analysis was undertaken to explore . relation 
ships. Product -moment correlations of massage means were 
almost all his:hly positive except where means were quite 
different and the number of respondents was small (11) • This 
is an indication that the test passages are all measuring 
the same thing. However, when three by two matrices (the 
three, readability levels on two passages) were tested for 
contingency coefficients (C), differences in difficulty level 
• were established. For ABE students, 13 of the C values . 
were large enough to indicate resrcnding patterns different 
at the .05 level. For HSE students, six out of 1^ compari- 
sons were significantly different. 

Subs tituta bill ty of cloze nrocedure - for standard ized 
tests could not be investigated because of flaws in the • 
data base. ' / . 

CONCLUSIONS. AND IMPLICATIONS 

If a variety of adult relevant reading materials are 
used for instruction, cloze procedure can be utilized as 
a satisf act^ory" and efficient v;ay tq match students to 
reading material and to group students by reading ability; 
As a staff develonr.ent nerson and evjaluation specialist , \ ' 
the researcher takes the liberty of 'going . beyond the 
research design to make the following suggestions about 
the use of cloze procedure in adult literacy programs; 
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1. If one must assign a grade equivalent severe, 
dardized reading test will apnear to be more 
and will be easier to explain, 

2. Cloze is not a panacea for unmotivated students. 

3. Although Bormuth's criterion levels appear acceptable 
for adults , examination of actual test passages reveals 

o that there are exceptions. Non-native speakers of. 

- Snglish might be more acceptably tested by a multiple 
choice format for completing deletions, with a concom- 
mitant change in criterion levels. 

i;. Cloze scores cannot be used as continuous data because 

cloze is a criterion-referenced measure. Thus-,, it yields 
only three scores: functional illiteracy , instructional 
reading level,, or independent reading level. Therefore, / 
it is not sensitive to small changes arid has limitations / 

- in evaluating either students or programs. . ■ ' ./ 

^« Cloze appears to effectively measure all of the reading/ 

variables rosited by Pry (5): legibility, word difficulty 
■ style diffioulty, picture or graph cues, students' / 
familiarity with subject matter,. and difficulty of th^ 
subject. Most readability . forumlae measure only one/or 
two variables, usually word and sentence Length. This 
makes cloze an especially good choice for use with/ 
" materials such as Learning Activity Packages and t)iose 
making extensive use of illustrations. 

■■ / 

6« An analysis of response patterns (item analysis )/may 

supr^est Particular Problem sPots that need to rewritten 

7. Systematic use of cloze could be used to estab/lish a data 
bank for grouping materials by readability le)/els. 

B. Cloze is not recommended for use with studer^^s reading 
below approximately fourth grade equivalent/ leve] . 

' ■ ■ ' / 

One positive finding with a negative imp]vication was 
that commercial materials were at a consistent: difficulty 
level. About one-third of the ABE students v/ere probably 
not able to gain information from the readings supposedly 
at their level. As many as two-thirds of tjie HSS students 
may not be able to gain information from t^^e review books 
from which passages were selected for thi^^ study. 

Cloze procedure merits f ur '--her r.ese^irch as both a 
testing and ins true ticnal ^ tool in adult /literacy programs. • 

/ 

/ 

- - / 
/ 
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